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It is shown how the macroscopic non-equilibrium dynamics of a class of sys- 
tems whose microscopic stochastic dynamics involves disordered and frustrated 
but range-free interactions can be well described by closed deterministic flow 
equations; this requires an appropriate choice of order parameters/function and 
ansatze. 



I. INTRODUCTION 

Given a system of many macroscopic units driving one another dynamically through strongly 
interactive, possibly mutually competitive and stochastically applied rules, one is often inter- 
ested in determining the temporal development of some macroscopic observable(s). In general 
this is a difficult task, normally impossible without approximation. However, when (i) the in- 
dividual units are identical, (ii) the microscopic update rules are instantaneous, and (iii) there 
is no spatial dependency to the interaction rules, experience with extremal dominance in equi- 
librium physics suggests that solution in a closed form for an appropriate set of observables (or 
order parameters) becomes at least potentially feasible in the limit in which the number of units 
N tends to infinity. Indeed, for simple enough units with uniform interaction rules, a closed 
autonomous dynamical equation can be obtained involving only a single order parameter. On 
the other hand, when the interaction rules are non-uniform and involve significant random char- 
acter the situation is very non-trivial even for the case of range-free interactions. Nevertheless, 
we have been able to make major progress with such problems, using a combination of exact 
results and ansatze to obtain closed autonomous macroscopic flow equations whose solutions 
are in very good accord with the results of numerical simulations of the microdynamics and 
suggest procedures to tackle other analagous and extended problems. In this paper we spell out 
the philosophy and execution of this new approach and demonstrate its application to simple 
models of spin glasses and recurrent neural networks. 



II. THE PROBLEM 



In general terms, we are concerned with systems whose microscopic state is described by a 
set of N variables Sf, i — 1...N which obey random stochastic microdynamics based on the 
instantaneous state of the other spins. Our objective is to devise a description of the subse- 
quent macrodynamics in terms of closed equations for fewer-parameter sets of macrovariables 
Q^S);^ = l...n. 

More specifically, let us initially concentrate on systems in which the variables S are binary 
spins {<7i = ±1} and obey random sequential Glauber stochastic dynamics via local effective 
fields determined through pairwise exchange interactions with other spins and external stimuli. 
Thus, the spins are updated randomly sequentially with transition probabilities 

p(ai -> al) = ~ [1 + a[ tanh[/?M<7)]] (1) 
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where 

= E + °i ( 2 ) 

and /3 _1 is a measure of the degree of stochasticity. With appropriate coarse- graining this leads 
to the master equation for the microstate distribution p t (<x) 

d N 

-p t {a) = J2 \pt{F k <T)Wk{F k a)-pt{cr)W k {cT)] (3) 
k=i 

where F k is the spin-flip operator 

F k ®(o-) = $&,..., -cr k ,...,<T N ), (4) 

Wfe(o') is the transition rate 

W k (a) = ^[l-a k t&iah(0h k (a))}, (5) 

and we are now using the vector notation er = (<7i, ct/v). 

From (0) we may derive an equation for the evolution of the macrovariable probability dis- 
tribution 

p t [n] = 5^p t (<r)*[n-n(<r)]i n = (ni,...n„) (6) 

er 

in the form 

|w = E ^ E •• E «irW^[^] 

dt e>i l - *i=i ^i "*!- **** 



(7) 



where 

*"£.*,[";*] = (E^( ff )VH-^H)n ;i = n*^) - <M<r) ( 8 ) 

3=1 

and the notation ()n ; t refers to a sub-shell average 

In several cases of interest and for finite times only the first term on the right hand side of 
(0) survives in the limit N — > oo, yielding the deterministic flow 

= <$2Wi(<j)[Sl{Fia) - n(o-)]) n . t . (10) 

In general this does not yet constitute a closed set of equations due to the appearance of pt(cr) 
in the sub-shell average. However, we may attempt to find an appropriate choice of Jl for which 
closure may be attained either exactly or approximately. Thus is done below for certain model 
systems. 
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III. SPECIFIC SYSTEMS 



One particularly simple example occurs for the case of an infinite range Ising ferromagnet in 
a uniform external field; Jij = Jq/N, Oi — 9 ext . In this case the magnetization to — N^ 1 J2i a i 
suffices alone as a macrovariable whose evolution is deterministic and closed, 

jm = tanh(/3(J TO + 6» e:Et )) -to, (11) 
and yields the usual mean field solution in the steady state limit 

4- m = -> TO = tanh(/3(J m + 6» e;l:t )). (12) 
dt 

A greater challenge is posed by problems with sufficient disorder and frustration, such as 
those given by 

Ji3 = Jo/N + Jzij/VN) (*,-} = (zij 2 ) = l; i + 3. (13) 

where Zij is a quenched random parameter. This is the case for two particular model problems 
of interest on which we shall concentrate; the Sherrington-Kirkpatrick (SK) spin glass Of] and 
the Hopfield neural network [^J. In the SK model the {a} represent true magnetic spins and 
the {Jij} are chosen randomly from a Gaussian distribution. In the Hopfield model the {cr} 
represent states of McCulloch-Pitts neurons, a = +1/— 1 corresponding to firing/non-firing, and 
the {Jij} provide for the storage and retrieval of random patterns {£f = ±1}; /i = l...p = aN, 
via the Hebb rule Jij = iV _1 X)u=i Concentrating for simplicity on the region of phase 

space within the basin of attraction of one pattern, fi = 1, it is convenient to apply the gauge 
transformation cr,; — > UiS,}, Jij —> ^l^jJij, @i — * £,}0i to re- write this in the form of ( |l3] ) with 

v p u,>l 

In both cases we shall take 8 ext — for simplicity in this note. It is straightforward to show 
that to = TV^ 1 J2i °t is insufficient for a closed macroscopic evolution for finite J, although it 
does suffice if J — > as — > oo, as is the case for a Hopfield model with only one condensed 
pattern, storing only a less than extensive number of patterns (limjv^oo a = 0). 

But how many macrovariables does one need and what are they? Before giving an answer 
to the last question which we believe to be at least very close to the truth, let us consider an 
intermediate step which is useful illustratively. Although our analysis applies to finite times, it 
is instructive to ask first about the long time steady state. For problems with detailed balance in 
their dynamics one knows that in the limit as t — > oo before N — > oo the microstate distribution 
takes the Boltzmann form Poo(<x) ~ exp(— /3-ff). This is the case in the above examples which 
have Jij — Jji, yielding the Hamiltonian 

H/N = -N- 1 ^ JijcncTj = -ij TO 2 (cr) - Jr(cr) + 0(iV- 1 ) (15) 

i<3 

where 

r(cr) = N- z l 2S £ j O l z l ,o r (16) 

i<j 

Thus, as long as r(er) ~ 0(1) it cannot be ignored in the set of f2. It is straightforward to show 
that r(<x) ~ 0(1) for both the SK spin glass and the Hopfield model at finite storage ratio a. 
Thus we shall first discuss an attempt to find a non-equilibrium macrodynamics in terms of 
m, r, alone, and show that it provides a reasonable but imperfect description. We shall then 
go on to a more sophisticated theory in terms of a generalized order function which provides a 
very good fit to the results of microscopic simulation. 
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IV. THE SIMPLE VERSION OF THE THEORY: TWO ORDER PARAMETERS 



In this section we choose the minimal form 

n s (a) = (Jli(tr), n a ( < r)) = (m(o-),r(tr)) . (17) 

The resultant Pt[f2 s ] does indeed satisfy a Liouville equation in the thermodynamic limit, 
yielding the deterministic flow equations 



dm 
~~dt 

dr 
~d~t ~ 



r ;t{z) tanh /3(J Q m + J z) — to (18) 



dzD mr . t (z)z tanh [3{J m + Jz) — 2r (19) 



where D m>r -j{z) is the sub-shell averaged distribution of the disorder contributions to the local 
fields 

n M EgftW^m - m{a))5{T - r{a))N^ £ t S(z - Zi (<r)) 

J-J m ,r;t\Z) — lim — — — — — (ZU) 

Af^oo l^a- Pt\fy)o{m - m{a))d(r - r(cr)) 

h i (a) = J o m((T) + Jz i (a)+0(N- 1 ) Zi (<r) = AT 1 / 2 z H a i ■ ( 21 ) 

3 

As yet, because of the pt(tr) in ( p0| ) , equations (|l^) and ( |l9| ) are not closed except in the 
disorder-free case J = 0. To close the equations we introduce two simple ansatze: (i) we 
assume that the evolution of the macrostate (to, r) is self-averaging with respect to the specific 
microscopic realization of the disorder {zij}, (ii) as far as evaluating D(z) is concerned we 
assume equipartitioning of the microstate probability pt(cr) within each (m, r) shell. The first 
of these ansatze is well borne out by computer simulations of the microscopic dynamics and 
permits averaging D(z) over pattern choices. The second, which is clearly true as t — > oo since 
Poo{&) depends only on to and r but can only be judged a posteriori for general time, eliminates 
memory effects beyond their reflection in to, r and removes explicit time-dependence from D. 
Together these ansatze give 

n M / Eg S(m - m(a))S(r - r(a))N^ 6(z - zjja)) \ 

Drn,r;t\ Z ) ~ > U m>r\Z) ~ ( ^ 77 / u 77 7^7 / {^) 

\ Eer 6 ( m - m(a))8(r - r{cr)) / {z .. } 

where (• • •) z .. indicates an average over the quenched randomness. This yields closure of (|l8| ) 
and ( |l9| ) since D m , r (z) now depends only upon the instantaneous values of m,r and no longer 
on other microscopic measures of history. 

The actual evaluation of D m ^ r (z) from (2^) remains a non-trivial exercise, but one which is 
amenable to solution by replica theory as developed for the investigation of local field distribu- 
tions in spin glasses |jj . After several manipulations it can be expressed in the form 

D in , r (z) = Um/'jJ [] dx?dyfeM~N<S>(m,r,z;{x?},{yf})} (23) 

i,j q,/3— l...n 

where the number of indices i,j is finite and $ is O(N ). Because the argument of the expo- 
nential scales as N, the integral can be evaluated by steepest descents. 

The extremization is complicated 0J^,^| and in its complete form involves significant sub- 
tleties, including an extension of those devised by Parisi for the analysis of the spin glass problem 
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It is discussed in detail elsewhere [@,||; here we note only a few salient results. Important 
among them is that in the steady state limit of dm/dt = drldt = the analysis yields the full 
thermodynamic results obtained from equilibrium analysis |l]|],||], including replica-symmetry 
breaking F° r more general times explicit analysis to date has only been completed within 
the further ansatz of replica-symmetry in the dynamic analogue of the spin glass order param- 
eter q a @ which enters into the evaluation of D m ^ r (z), but including a determination of the limit 
of its applicability against small replica-symmetry breaking fluctuations (cf. [lC| ]. 

The full analytic results for this case can be found in [Qj8| . Here we simply exhibit graphically 
the comparisons between theory and microscopic simulation for the Hopfield model for a = 0.1 
and deterministic microdynamics; similar results hold for arbitrary a and T. Fig 1 shows flows 
in (m,r), with time implicit, and it is observed that the comparison is quite good (but not 
perfect); it also clearly shows the need for (at least) two order parameters. On the other hand, 
Fig 2, which shows the dependence of m and r on t, demonstrates that the theory misses a 
slowing-down effect seen in the simulations for non-retrieving situations (ie. ones in which 
limj_ >00 TO(i) = 0). One may further note that the slowing-down occurs before the system 
crosses the limit of replica-symmetry stability against small fluctuations, suggesting that its 
origin lies other than in the breakdown of the RS ansatz used in the evaluation of D(z). R! 
ather, one is driven to conclude that the problem lies in the loss of memory information inherent 
in the assumption of equipartitioning in the form used above. This implies that the set of n 
must be expanded beyond just m and r, to include more microscopic effects. 
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FIG. 1. Macroscopic flow trajectories for a Hopfield model with storage capacity a = 0.1 and de- 
terministic microscopic dynamics (/3 = oo); dots indicate simulations (TV = 32000), solid lines indicate 
analytic RS theory. The outer dashed line is the boundary predicted by RS theory; the inner dashed 
line indicates the onset of instability against RS-breaking fluctuations, with stability on the side closer 
to the origin. 
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FIG. 2. Temporal dependence of the order parameters for a Hopfield model with storage a — 0.1 and 
zero-temperature dynamics (/3 = oo); dots indicate simulations (N — 32000), the other lines indicate 
RS theory shown with solid lines where stable, dashed lines where unstable. Time is measured in Monte 
Carlo steps per spin. 



V. THE SOPHISTICATED VERSION OF THE THEORY: ORDER FUNCTION 

DYNAMICS 

To improve on the theory as developed in the last section requires broadening the range 
of order parameters. Addition of a finite number of extra observables, although technically 
relatively straightforward to effectuate, is not however expected to give more than just minor 
improvements; rather, a qualitative change of philosophy would seem to be required. To this 
end we propose instead for l~i the joint spin-field distribution 



Our motivation for this choice is the following 

1. The previous two dynamic parameters m(<x) and r(<x) can be written as moments off 

h; <t), so the advanced theory automatically inherits the exactness in the two solvable 
limits t — ► oo and J — > 0. 

2. The order parameter function D(<;,h) specifies the underlying states cr to a much higher 
degree than (m, r); i.e. more microscopic memory is taken into account. 

3. The microscopic equation (0) itself is formulated in terms of spins and fields. 




(24) 



4. The choice (24) allows for immediate generalization to models without detailed balance 
and to soft-spin models. 



Strictly, D is infinite-dimensional through h in the limit N —> oo, but in practice we expect 
it to be quasi-continuous and well-behaved (smooth). Hence we assume that we can evaluate 
it at a number I of field values and take the limit I — > oo after the limit N — > oo. We then 
have 2£ macrovariables i\ M (er) = D(q, h^; er), with /x = 1, . . . , t and c = ±1. 

We may consider the distribution 



P t [D(s, h)\ = ]T Pt(<r)5[D(<;, h) - £>(?, h; a) 



(25) 



and analyze its evolution in a manner analagous to that applied earlier to Pt(m, r). For finite I 
it is again found to satisfy a Liouville equation for finite t and N — > oo, resulting in deterministic 
evolution of D t {<;, h). As before, this equation is not a priori closed since it involves expressions 
of the form 



(f{°))D;t = 
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£>(c,V>- 


jr'Lj^,a j S[h li -h j {tr)] 











(26) 



where pt(cr) again implies knowledge of the full microstate distribution. Again, to achieve 
closure, we apply our two anzatze of self-averaging and equipartitioning, but in this case the 
latter is far less questionable since it assumes only that all microstates with the same distribution 
D{<;,h) contribute equally (and not all states with the same two moments of that distribution 
m and r). After some manipulation we obtain the relatively simple closed evolution equation 

J^AM) = \ [l+^tanh^)] AK/i)- ^ [l-<rtanh(/3/i)] D t (<;,h) 



+ A |a(c,/i) [h-0-J o (tanh(/3H)) Dt ] +A[<;,h;D t ] + J 2 [l-^tanh^))^] J- AM) 



(27) 



with 



.4[<r,/i; D t ] = - Jrm^ — = ^((^ tanh(^/i i (o-))^ iffj .<J[/i-/i J -(o-)])) £ ) t 



(28) 



where 



(/(tr,fr)) D = 2 y dHf(a,H)D(a,H) 



(29) 



and 



(T 1 <7™ a=l <;^t 



){«*!}■ 



(30) 
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FIG. 3. Evolution of the binding energy of the Sherrington-Kirkpatrick spin glass (J D = 0) from a 
random microscopic start. Comparison of simulations (N = 8000, solid line) and predictions of the 
simple two-parameter (m, r) theory of section IV (RS stable, dotted; RS unstable, dashed) and of the 
advanced order- function theory of section V (solid), for (3 = oo. Note that the two solid lines are almost 
coincident. 
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FIG. 4. Field distribitions D t (a,h) in the J = 1 SK model at T = 0, for Jo = (left) and Jo = 1 
(right) . Histograms: numerical simulations with iV = 8000; lines: result of solving the RS diffusion 
equation. 
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Replica theory can again be employed to determine the averages (|3C|) to yield a closed au- 
tonomous equation for D t (s,h), although explicit numerical solution still involves the solution 
of a set of complicated saddle point equations; for details see jy]. To date we have only per- 
formed the evaluation within the RS ansatz. Results for the case of an SK model with Jo = 
are exhibited graphically in Figs 3 and 4, together of microscopic simulation and, in Fig 3 of 
the simpler theory of Section IV. It may be noted that the advanced theory is in good accord 
with the simulations, quite convincingly describing the transients of the simulation experiment, 
including the hitherto unexplained slowing down. Equally good fits for Dt(a,h) are obtained 
at finite temperature ( Q). 

Replica-symmetry breaking analysis remains to be performed for arbitrary t, but we note that 
the difference in the asymptotic limit t — > oo is known from equilibrium theory where replica- 
symmetric theory gives t\rs(oo) — 0.798, while the full replica-symmetry breaking theory gives 
^flss(oo) = 0.763, the difference between which is very small on the scale of Fig 3. 

VI. BEYOND DETAILED BALANCE 

The sophisticated version of our theory, as discussed in the last section, does not make use 
of detailed balance and in ( |2l| ) /ij(er) is simply given by (||), irrespective of the relationship 
between and Jji . The analysis goes through as in (|24|) to ( |30| ) even for more general choices 
of Zij not necessarily equal to Zji. To illustrate its efficacy we have compared calculations and 
simulations for the case of an antisymmetric SK model with = —Zji with the Zif,j ^ i 
independently Gaussian distributed, with good agreement both at zero and finite temperature; 
we illustrate the results for T = dynamics in Figs 5 and 6. 




2 4 6 2 4 
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FIG. 5. Magnetization m and energy per spin E in the asymmetric J = 1 SK model at T = 0, for 
Jo = (left) and Jo = 1 (right) . Solid lines: numerical simulations with N = 5600; dotted lines: result 
of solving the RS diffusion equation. 
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FIG. 6. Field distribitions Dt(a,h) in the asymmetric J = 1 SK model at T — 0, for Jo = (left) 
and Jo = 1 (right) . Histograms: numerical simulations with N = 5600; lines: result of solving the RS 
diffusion equation. 



VII. GENERALIZATIONS 



So far we have considered only binary- valued micro variables. However, the treatment above 
can be extended to more general microvariables Si, where the overarrow denotes a low- 
dimensional vector^], governed by some more general master equation for pt(S). If we con- 
tinue to restrict to situations in which the instantaneous dynamics of Si is determined, possibly 
stochastically, by a local force Fi(S) then the natural extension of the order function of section 
V is 



V(S,F; S) 



Si)6(F - Fi(S)) 



An equation of motion for 

V{V{S,T)) = Y,Pt(S)5lV(S 7 F)-V(S,f- S)] 



(31) 



(32) 



may be generated as discussed above and in appropriate limits of time and size can be expected 
to lead again to deterministic flows for T>(S, T ). These in turn will in general involve force- 
fluctuation analogues of the noise distribution (p0|) and can in turn be closed via self-averaging 
and equipartitioning ansatze. We shall not, however, consider this more explicitly here. 



x as opposed to the bold notation which indicates an TV- dimensional vector 
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It may or may not be that a macroscopic observable of interest can be obtained from V(S,T) 
alone. If this is not the case the order function must be expanded to allow for their evaluation. 



VIII. CONCLUSION 

We have demonstrated that for problems with instantaneous microscopic update dynamics, 
which may invove both quenched and stochastic randomness provided that the interactions are 
drawn from range- free distributions, one can derive closed autonomous deterministic dynamics 
for appropriately chosen order parameters, in good accord with simulations for examples stud- 
ied. In principle, extensions to finite-range interactions could be considered but would involve 
greater approximation. 
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